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(54) siomNG T meSium OCESS,NG DEV,CE AND processing me ™od and program 



(57) An information processing apparatus for suita- 
bly corresponding a plurality of images as an editing ob- 
ject to each of a plurality of scenes constituting scenario 
data. In the apparatus, when a read button (211) is op- 
erated, a material clip (212) as an editing object is dis- 
played on a material tray (201). When a tag (271-1) is 
selected, a shaker window having a section button (281) 
is displayed. Scenarios correspond to a plurality of se- 



lection buttons (281), respectively. The number of 
scenes, an effect given to each scene and the like are 
designated to each scenario. A user selects one selec- 
tion button (281) to select one scenario. When a shake 
button (285) is operated, a predetermined one is select- 
ed at random out of material clips (212) designated in 
advance by a user to assign it to each scene of the sce- 
nario selected by the user. 
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Description 

Technical Field 

[0001 ] The present invention relates to an information 
processing apparatus and processing method and a 
storage medium, and particularly, relates to an informa- 
tion processing apparatus and processing method and 
a program storage medium for the purpose of editing 
image data. 

Background Art 

r0002] With the enhancement of function, a personal 
computer is capable of editing not only text data but also 
imaqe data. 

r0003] For editing image data using a personal com- 
puter it is necessary that a user has to learn operating 
f unction of a personal computer, and it takes time to ob- 
tain the intended result of edition. 

Disclosure of the Invention 



[0004] It is an object of the present invention to solve 
the problem noted above with respectto the convention- 
al information processing apparatus of a personal com- 
puter and to provide a new information processing ap- 
paratus and processing method, and a program storage 
medium capable of editing image data simply and quick- 

[0005] The information processing apparatus acoord- 
ino to the present invention comprises a storage medi- 
um for storing scenario data constituted by a plurality of 
scenes, and corresponding means for suitably corre- 
sponding a plurality of images as an editing objects to 
the respective plurality of scenes constituting scenano 
data stored in the memory medium. 
[0006] Hereupon , the plurality of scenes can be made 
to predetermined lengths difference from each other. 
There can befurtherprovided modifying means for mod- 
Hying an image corresponded by the correspond.ng 
means in adjustment to the length of a scene. 
[0007] There can be further provided reproducing 
means for continuously reproducing a plurality of imag- 
es corresponded by the corresponding means on the 
basis of scenario data. _ 
[0008] The reproducing means can apply special ef- 
fect infonnation to a plurality of images on the basis of 
predetermined special effect information corresponded 
to a scene to reproduce it. 

[0009] There is further provided deciding means for 
suitably deciding special effect information to be corre- 
sponded out of a plurality of special effect infonnation 
with respectto a scene, and the reproducing means ap- 
plies special effect information to a plurality of mages 
on the basis of the decided result of the deciding means 
to reproduce it. 

[0010] The corresponding means suitably corre- 



sponds a plurality of images as editing objects with re- 
spect to a plurality of scenes of scenario data selected 
out of a plurality of scenario data. 
[0011] There can be further provided registration 

5 means for registering images as editing means, image 
information display means for displaying in list informa- 
tion relating to a plurality of image information as editing 
objects, and output information display means for ar- 
ranging and displaying information relating to a plurality 

10 of images corresponded by the corresponding means in 
accordance with order of a plurality of scenes. 
[0012] The corresponding means is able to carry out 
corresponding using a scenario corresponding to in- 
structions from a user out of a first scenario with repet- 

15 itive continuous reproducing as a premise and a first 
scenario with repetitive continuous reproducing as not 

a premise. 

[0013] Further, the information processing method 
according to the present invention includes a corre- 
20 spondence processing step for suitably corresponding 
a plurality of images as editing objects with respect to a 
plurality of respective scenes constituting scenario data, 
a modification processing step for modifying respective 
images corresponded in adjustment with lengths of re- 
25 spective scenes, and a reproducing processing step for 
continuously reproducing a plurality of images. 
[0014] There can include a decision processing step 
for suitably deciding special effect information corre- 
sponded out of a plurality of special effect information 
so with respectto scenes. 

[0015] There can include an image information dis- 
play processing step for displaying in list information re- 
lating to a plurality of images as editing objects, and an 
output information display processing system for ar- 
35 ranging and displaying information relating to a plurality 
of images corresponded in the correspondence 
processing step in accordance with order of a plurality 
of scenes. 

[0016] The program according to the present inven- 
40 tion includes a correspondence processing step for suit- 
ably corresponding a plurality of images as editing ob- 
jects with respect to a plurality of respective scenes con- 
stituting scenario data, a modification processing step 
for modifying respective images corresponded in adjust- 
45 ment with lengths of respective scenes, and a reproduc- 
ing processing step for continuously reproducing a plu- 
rality of images. 

[0017] There can further include a decision process- 
ing step fro suitably deciding special effect information 
so out of plurality of special effect information with respect 
to scenes. 

[0018] There can further include an image information 
display processing step for displaying in list information 
relating to a plurality of images as editing objects, and 
55 an output information display processing step for ar- 
ranging and displaying information relating to a plurality 
of images corresponded in the correspondence 
processing step in accordance with order of a plurality 
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of scenes. 

[001 9] In accordance with the information processing 
apparatus and the processing method, and the pro- 
gram, image information is corresponded to the ob- 
tained scene. 5 
[0020] The other objects of the present invention, and 
the detailed advantages obtained by the present inven- 
tion will be further apparent from the ensuing explana- 
tion of the embodiments. 

10 

Brief Description of the Drawings 

[0021] FIG. 1 is a perspective view showing an exter- 
nal appearance of a personal computer to which the 
present invention is applied, FIG. 2 being a plan view 15 
thereof, FIG. 3 being a left side view thereof, FIG. 4 be- 
ing a right side view thereof, FIG. 5 being a front view 
thereof, and FIG. 6 being a bottom view thereof. 
[0022] FIG. 7 is a block diagram showing a constitu- 
tional example of the interior of the personal computer 20 
shown in FIG. 1. 

[0023] FIG. 8 is a view showing a display example of 
LCD provided on the personal computer shown in FIG. 
1. 

[0024] FIG. 9 is a view showing a display example of 25 
a portion of a material tray shown in FIG. 8. 
[0025] FIG. 10 is a view showing a display example 
of an image taken from a CCD video camera shown in 
FIGl 7. — • - - - — ----- 

[0026] FIG. 11 is a view showing an example of an 
image file taken into the material tray shown in FIG. 8. 
[0027] FIG. 1 2 is a view showing an example of trim- 
ming of a reproduced image plane shown in FIG. 8. 
[0028] FIG. 1 3 is a view for explaining rearrangement 
of a clip of an output tray shown in FIG. 8. 
[0029] FIG. 14 is a view showing a display example 
of windows in a case where a volume button shown in 
FIG. B is operated. 

[0030] FIG. 15 is a view showing a display example 
of windows in a case where a color tone button shown 
in FIG. 8 is operated. 

[0031] FIG. 16 is a view showing a display example 
of windows in a case where a reproducing speed button 
shown in FIG. 8 is operated. 

[0032] FIG. 17 is a view showing a display example 
of text windows of a special effect tray shown in FIG. 8. 
[0033] FIG. 18 is a view showing a display example 
of effect windows of a special effect tray shown in FIG. 8. 
[0034] FIG. 19 is a view showing a display example 
of transition windows of a special effect tray shown in 
FIG. 8. 

[0035] FIG. 20 is a view showing a display example 
in a case where transition of an output tray shown in 
FIG. B is applied. 

[0036] FIG. 21 is a view showing a display example 
for explaining a wipe effect. 

[0037] FIG. 22 is a view showing a display example 
of shaker windows of a special effect tray shown in FIG. 



8. 

[0038] FIG. 23 is a view showing a display example 
of windows in a case where an output button shown in 
FIG. 8 is operated. 

[0039] FIG. 24 is a view showing an example of edit- 
ing information of a simple storage. 
[0040] FIGS. 25A to 25C are respectively flowcharts 
for explaining shaker processing. 
[0041] FIGS. 26A and 26B are respectively views for 
explaining the constitution of a scene. 
[0042] FIGS. 27A to 27D are respectively views for 
explaining the constitution of a scene with continuous 
repetitive reproducing as a premise. 
[0043] FIG. 28 is a view for explaining shaker process. 

Best Mode for Carrying out the Intention 

[0044] The information processing apparatus accord- 
ing to the present invention will be described hereinafter 
with reference to the drawings. This information 
processing apparatus is constituted as a portable per- 
sonal computer, which is constituted as sown in FIGS. 
1 to 6. This personal computer 1 is constituted as a small 
note type personal computer, which comprises a body 
2, and a display part 3 mounted to be opened and closed 
freely on the body 2, as shown in FIGS. 1 and 2. 
[0045] FIG. 1 is an external perspective view showing 
a state that the display part 3 of the personal computer 
1 is opened "with res^ctTo the"b6dy '2, FIG. 2'bein'g'a 
plan view thereof, FIG. 3 being a left side view thereof 
showing a state that the display part 3 is closed with 
respect to the body 2, FIG. 4 being a right side view 
showing a state that the display part 3 is opened by 1 80 
degrees with respect to the body 2, FIG. 5 being a front 
view thereof, and FIG. 6 being a bottom view thereof. 
[0046] On the body 2 are provided a keyboard 4 op- 
erated when various letters or characters and symbols 
are input, and a stick system pointing device 5 when a 
mouse cursor is moved on the upper surface thereof. 
On the upper surface of the body 2 are further provided 
speakers 8-1, 8-2 for outputting sound, and a shutter 
button 10 operated when an image is picked up by a 
CCD video camera 23 provided on the display part 3. 
[0047] The display part 3 is connected to be opened 
and closed freely to the body 2 by means of hinges 9-1 
and 9-2. A battery 7 is detachably mounted between one 
hinge 9-1 and the other hinge 9-2 of the body 2. 
[0048] A pair of pawls 13-1 and 13-2 are provided on 
the both sides on the extreme end side of the display 
part 3, as shown in FIG. 1 . On the body 2 side are pro- 
vided engaging holes 6-1 and 6-2 which come in en- 
gagement with the pawls 13-1 and 13-2 when the dis- 
play part 3 is rotated in the state closed with respect to 
the body 2, as shown in FIG. 3. 

[0049] On the extreme end side of the display part 3 
is mounted a microphone 24 adjacent to an image pick- 
up part 22. The microphone 24 is constituted so as to 
enable collecting also sound incident from the back of 
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the display part 3, as shown in FIG. 6. 
[0050] The body 2 is provided on one side with an ex- 
haust hole 11 as shown in FIG. 3, and is provided also 
at the lower part on the front side of the body 2 with a 
suction hole 14 as shown in FIG. 5. Further, on one side 
in which the exhaust hole 1 1 of the body 2 is provided a 
slot 1 2 into which a card in compliance with the standard 
defined by PCMCIA (Personal Computer Memory Card 
International Association), that is, a PC card is inserted, 
as shown in FIG. 3. 

[0051] An LCD (Liquid Crystal Display) 21 for display- 
ing an image is provided, as shown in FIGS. 1 and 2, in 
the front of the display part 3, and an image pick-up part 
22 is provided rotatably with respect to the display part 
3 on the upper end thereof. This image pick-up part 22 
is constituted to be rotated to a suitable position in a 
range of 1 80 degrees between the front direction of the 
LCD 21 and the back direction on the opposite thereto. 
A CCD video camera 23 is mounted on the image pick- 
up part 22. 

[0052] On the front end side on the face side in which 
th keyboard 4 of the body 2 is provided, there are pro- 
vided a power lamp PL, a battery lamp BL, a message 
lamp ML, and other lamps formed of LED. On the rear 
end side to which the display part 3 of the body 2 is con- 
nected, there is provided a power switch 40 adjacent to 
the shutter button 1 0 as shown in FIG. 1 . Further, on the 
front end of the body 2, there is provided an adjusting 
ring 25 for adjusting focussing of a CCD video camera 
23, as shown in FIG. 5, and on the bottom side of the 
body 2, there is provided a mounting part for an expan- 
sion memory to be mounted on the body 2, as shown in 
FIG. 6. The mounting part is normally covered with a lid 
26. 

[0053] Next, the internal constitution of the personal 
computer 1 will be described with reference to FIG. 7. 
[0054] A central processing unit (CPU) 51 is received 
and arranged in the personal computer 1 . The CPU 51 
is constituted by, for example, a Pentium (Trademark) 
processor or the like manufactured by Intel Co. , and 
connected to a host bus 52. Further, a bridge 53, a so- 
called north bridge, is connected to the host bus 52. The 
bridge 53 has an accelerated graphics port (AGP) 50 
and is connected to a peripheral component intercon- 
nect/interface (PCI) 56. 

[0055] The bridge 53 is constituted by, for example, 
400BX or the like which is an AGP host bridge controller 
manufactured by Intel Co., to control CPU 51 and RAM 
(Random-Access Memory) 54 (so-called, main memo- 
ry) and the like. Further, the bridge 53 controls a video 
controllers? through AGP 50. It is noted that a so-called 
chip set is constituted by the bridge 53 and a bridge (so- 
called, south bridge (PCI-ISA Bridge))58. 
[0056] The bridge 53 is also connected to a cash 
memory 55. The cash memory 55 is constituted by a 
memory capable of executing write or read operation at 
higher speed than RAM 54 such as SRAM (Static RAM) 
to temporarily store programs or data used by CPU 51 . 



[0057] It is noted that CPU 51 is internally provided 
with a memory which can be operated at higher speed 
than the cash memory 55 and a cash memory controlled 
by CPU 51 itself. 

5 [0058] RAM 54 is constituted by, for example, DRAM 
(Dynamic RAM) to store programs executed by CPU 51 
or data necessary for operation of CPU 51 . Concretely, 
for example, RAM 54 stores e-mail program 54A, auto- 
pilot program 54B, operating program (OS) 54C, shaker 

10 program 54D : capture program 54E, and other applica- 
tion programs 54F1 to 54Fn, loaded from HDD 67 at the 
time when start is completed. 

[0059] The e-mail program 54 is a program for deliv- 
ering and receiving an electronic message, a so-called 

*5 e-mail through a communication circuit such as a tele- 
phone circuit 76 through a modem 75. The e-mail pro- 
gram 54A has a received-mail obtaining function. The 
received-mail obtaining function ascertains a mail serv- 
er 78 provided by an internet service provider 77 wheth- 

20 er or not a mail addressed to a user is received within a 
mailbox 79, and if a mail addressed to a user is present, 
executes process for obtaining it. 
[0060] The autopilot program 54B is a program which 
is processed by starting a plurality of preset processes 

25 (or programs) or the like in preset order. 

[0061] The OS (Operating System) program 54C Is, 
for example, a program which controls basic operation 
of a computer represented by a so-called Windows 95 
(Trademark) of Windows 98 (Trademark) of Microsoft 

30 Co., or a so-called MacOS (Trademark) of the Apple 
Computer Co. 

[0062] The shaker program 54D is a program which 
executes automatic editing process. The capture pro- 
gram 54E is a program which controls incorporation of 

35 a pick-up image by the CCD video camera 23. 

[0063] The video controller 57 is connected to the 
bridge 53 through AGP 50 to receive data (image data 
or text data) supplied from CPU 51 through the AGP 50 
and the bridge 53 to produce imaged data correspond- 

40 jng to the received data or to store the received data 
without modification in a video memory (not shown) 
housed therein. The video controller 57 causes LCD 21 
of the display part 3 to display an image corresponding 
to image data stored in the video memory. Further, the 

45 video controller 57 supplies video data supplied form the 
CCD video camera 23 to RAM 54 through the PCI bus 
56. 

[0064] A sound controller 64 is connected to the PCI 
bus 56. The sound controller 64 incorporates a signal 

so corresponding to voice from the microphone 24 to pro- 
duced data corresponding to voice to output it to RAM 
54. Further, the controller 64 drives a loud speaker 8 to 
output voice to the loud speaker 8. 
[0065] Further, the modem 75 is connected to the PCI 

55 bus 56. The modem 75 transmits predetermined data to 
a communication network 80 or a mail server 78 of an 
Internet or the like through a public telephone circuit 76 
and an internet service provider 77, and receives pre- 
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determined data from the communication network 80 or 
the mail server 78. 

[0066] A PC card slot interface 111 is connected to 
the PCI bus 56 to supply data supplied from an interface 
card 112 mounted in a slot 12 to CPU 51 or RAM 54, 5 
and outputs data supplied from CPU 51 to the interface 
card 112. A drive 113 is connected to the PCI bus 56 
through the PC card slot interface 111 and the interface 
card 112. 

[0067] The drive 113 reads data recorded in a mag- 10 
netic disk 121 , an optical disk 122. an optical magnetic 
disk 1 23 or a semiconductor memory 1 24 to be mounted 
as necessary, and supplies the read data to RAM 54 
through the interface card 1 1 2 ; the PC card slot interface 
111, and the PCI bus 56. 15 
[0068] Further, a bridge 58, a so-called south bridge 
is also connected to the PCI bus 56. The bridge 58 is 
constituted by, for example, PIIX4E (Trademark) manu- 
factured by Intel Co., and .houses therein an IDE (Inte- 
grated Drive Electronics) controller/configuration regis- 20 
ter 59, a timer circuit 60, an IDE interface 61 , and a USB 
interface 68 and so forth. The bridge 58 controls various 
kinds of I/O (Input/Output) such as a device connected 
to an IDE bus 62, or a device connected through an ISA/ 
EIO (Industry Standard Architecture / Extended Input 
Output) bus 63 or an I/O interface 69. 
[0069] The IDE controller/configuration register 59 is 
constituted by, though not shown, two IDE controllers, 
"i.e., a so-called pTimary IDE' controller and' a secondary 
IDE controller, and a configuration register and so on. 
[0070] HDD 67 is connected to the primary IDE con- 
troller through the IDE bus 62. Further, a so-called IDE 
device such as a CD-ROM drive or HDD not shown is 
mounted on other IDE bus, the mounted IDE device is 
electrically connected to the secondary IDE controller. 
[0071 ] Recorded in the HDD 67 are a shaker program 
67D, a capture program 67E, and others, a plurality of 
application programs 67F1 to 67Fn as an e-mail pro- 
gram 67A, an autopilot program 67B, OS67C, and an 
application program. The e-mail program 67A, the au- 
topilot program 67B, the OS67C, the shaker program 
67D, the capture program 67E, and the application pro- 
grams 67 Fl to 67 Fn recorded in the HDD 67 are se- 
quentially supplied and loaded on the RAM 54 during 
the start (boot-up) process. 

[0072] The USB interface 68 receives an analogous 
noise code from a GPS antenna 1 06 connected through 
a USB port 107, and transmits the received analogous 
noise code to the RAM 54 through the PCI bus 56. 
[0073] The timer circuit 60 supplies data indicative of 
the present time to the CPU 51 through the PCI bus 56 
in response to a request from various programs. 
[0074] An I/O interface 69 is further connected to the 
ISA/EIO bus 63. The I/O interface 69 is constituted by 
an embedded controller, and the ROM 70, the RAM 71 , 
and the CP 72 are connected one another therein. 
[0075] The ROM 70 stores in advance therein an 
IEEE 1394 interface program 70A, a LED control pro- 



gram 70B, a touch pad input monitor program 70C, a 
key input monitor program 70D, and a wake-up program 
70E. 

[0076] The IEEE 1394 interface program 70A trans- 
mits and receives data in compliance with the standard 
defined in IEEE1394 (data stored in a packet) through 
an IEEE1394 port 101. The LED control program 70B 
controls turning on/off of a power lamp PL, a battery 
lamp BL, and a message lamp ML or other lamps com- 
prising LED as necessary. The touch pad input monitor 
program 70C is a program for monitoring input from a 
touch pad 33 corresponding to operation of a user. 
[0077] The key input monitor program 70D is a pro- 
gram for monitoring input from the keyboard 4 or other 
key switches. The wake-up program 70E is a program 
which checks whether or not the time is a preset time 
on the basis of data indicative the present time supplied 
from the timer circuit 60 of the bridge 58, and adminis- 
ters power supplies of respective chips constituting the 
personal computer 1 in order to start the predetermined 
process. or programs when the time is a set time. 
[0078] A BIOS (Basic InpuVOutput System) 70G is 
further written in the ROM 70. The BIOS 70G controls 
reception and delivery of data, that is, input/output of 
data between OS or application program and peripheral 
equipment (touch pad 33, keyboard 4 or HDD 67). 
[0079] The RAM 71 has an LED control, a touch pad 
input status, a key input status, or registers for the set 
time, or ani EEE 1 3941 /F-register,- as-registers-7 tA* to 
71 F. For example, in the LED control register, when the 
e-mail program 54A is started, a predetermined value is 
stored, and turning on/off of the message lamp ML is 
controlled in response to the value stored. The key input 
status register stores a predetermined operating key 
flag. In the set time register, a predetermined time is set 
in response to operation of the keyboard 4 by a user. 
[0080] The touch pad 33, the keyboard 4, the 
IEEE1394 port 101 and the shutter button 10 are con- 
nected to the I/O interface 69 through a connector not 
shown to output to the ISA/EIO bus 63 signals corre- 
sponding to operation with respect to the stick type 
pointing device 5, the touch pad 33, the keyboard 4, or 
the shutter button 10. Further, the I/O interface 69 con- 
trols reception and delivery of data with respect to equip- 
ment connected, through the IEEE1394 port 101. Fur- 
ther, a power lamp PL, a battery lamp BL, a message 
lamp ML, and lamps formed from the power control cir- 
cuit 73 and other LED are connected to the I/O interface 
69. 

[0081 ] The power control circuit 73 is connected to a 
housed battery 74 or an AC power supply to supply nec- 
essary powerto respective blocks and controls charging 
of the housed battery 74 or a second battery of periph- 
eral equipment. The I/O interface 69 monitors a power 
switch 40 operated when power is turned on or off. 
[0082] The I/O interface 69 executes the IEEE1394 
interface program 70A to the wake-up program 70E by 
the power supply provided therein even in a state that 
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power is off. That is, the IEEE1394 interface program 
70A to the wake-up program 70E are always operating. 
[0083] FIG. 8 represents a display example of an im- 
age displayed on LCD 21 when a shaker program 54D 
is started. As shown in FIG. 8, a material tray 201 is at 
the left upper part of an image plane. A read button 21 1 
is displayed on the material tray 201 . The read button 

21 1 is operated by a user when the user attempts to read 
information as an editing object in a case where the user 
attempts to edit predetermined image information. This 
operation is carried out by operating a sticktype pointing 
device 5. The material tray 201 is shown in an enlarged 
scale in FIG. 9. 

[0084] For example, when a user starts a capture pro- 
gram 54E, a video controller 57 outputs an image picked 
up by a CCD video camera 23 to LCD 21 and displays 
it. FIG. 10 represents an example of an image displayed 
in a manner as described. 

[0085] When a user operates a shutter button 1 0 in a 
predetermined timing, a video controller 57 supplies and 
stores stationary image or animation data displayed on 
an LCD 21 at that time. The image data is supplied from 
a RAM 54 to a hard disk 67 and stored as necessary. 
[0086] The user reads the image data stored in the 
RAM 54 or the hard disk 67 as described above and 
operates a read button 211 to enable storing the image 
data in the RAM 54 as a material clip which is an image 
of the editing object. The image data placed in a shake 
object as described is displayed" as "a material clip 212 
on the material tray 201 . As shown in an enlarged scale 
in FIG. 9, on the right side of the material clip 212 are 
displayed a title of the material clip, a distinction be- 
tween animation and a stationary image, and reproduc- 
ing time. A scroll bar 21 3 is operated by a user when the 
material clip 21 2 is scrolled in a case where the number 
of material clips 21 2 increases so that all of them cannot 
be displayed in the range of the material tray 201 . 
[0087] The files capable of being material clips as ob- 
jects of edition can be animations having an extension 
such as .MOV and .AVI, stationary images having an 
extension such as .BMP, .GIF, JPG, .PNG and PCT or 
music having an extension such as .WAV and .AIF 
[0088] On the right side of the material tray 201 is dis- 
played a reproducing image plane 221 as shown in FIG. 
8. By the user, when a stick type pointing device 5 is 
operated, predetermined one out of the material clips 

212 displayed on the material tray 201 is designated, 
and a reproducing button 231 is operated, the designat- 
ed image is reproduced and displayed on the reproduc- 
ing image plane 221. At this time, as reproducing 
progresses, a reproducing position display button 235 
moves in its display position from left to right according 
to the reproducing position. 

[0089] Also as shown in FIG. 12, a start point is des- 
ignated by a pointer 234L, and a termination point is des- 
ignated by a pointer 234R whereby a predetermined 
range of an animation image can be subject to trimming. 
In a case where trimming is done, only the image data 



subjected to trimming will be an image for a substantial 
• editing object. 
[0090] When a designation range reproducing button 
232 is operated, only the range subjected to trimming 
5 as described is displayed on a reproducing image plane 
221 . In a case where a rewinding button 236 is operated, 
a display image on he reproducing image plane 221 is 
rewound and displayed in a direction from new image 
to an old image by time. In a case where a quick traverse 
fo button 237 is operate, an image displayed on the repro- 
ducing image plane 221 is quick-traversed. 
[0091 ] When a mode button 233 is operated in a state 
of a story reproducing mode, the mode is changed to an 
editing mode, and when the mode button 233 is operat- 
es ed in a state of the editing mode, the mode is changed 
to the story reproducing mode. 

[0092] In the editing mode, for example, when a re- 
producing button 231 is operated, a material clip 212 
designated out of a material tray 201 at that time is dis- 
played on a reproducing image plane 221 , but in a state 
that the story reproducing mode is set, when the repro- 
ducing button 231 is operated, it is displayed on an out- 
put tray 291 as described later. A story (scenario) edited 
automatically or manually is reproduced from the begin- 
ning to the end. 

[0093] When the editing process is carried out manu- 
ally instead of automatically, a user selects a predeter- 
mined one out of material clips 212 displayed on the ma- 
terial tray 201 , and gets drag and drop to a suitable po- 
sition of a plurality of image display parts 301 A on an 
image truck 301 shown in FIG. 13 to thereby prepare a 
scenario of a story as desired. The image as a material 
clip once subjected to drag and drop to the predeter- 
mined image display part 301 A can be moved by further 
getting drag and drop on the image display part 301 A at 
the other position. 

[0094] In a case where a music file is present on the 
material tray 201 , a user gets drag and drop a material 
clip 21 2 designated by an icon of the music file to a BGM 
truck 302 on an output tray 291 to enable voice thereof 
to correspond as BGM. The length assigned with music 
information on the BGM truck 302 corresponds to that 
of music information. Accordingly, in a case where the 
length of the music information is short, separate music 
information Is subjected to drag and drop on the BGM 
truck 302 to thereby assign information. 
[0095] On the right side of the reproducing image 
plane 221 are displayed a volume button 241, a color 
tone button 242, and a reproducing speed button 243. 
When the volume button 241 is operated, a window 331 
as shown in FIG. 14 is displayed under the volume but- 
ton 241 . The user operates an adjusting br 332 whereby 
the volume at the time of outputting voice as an editing 
object can be adjusted. 

[0096] When the color tone button 242 is operated, a 
window 341 as shown in FIG. 15 is displayed under the 
color tone button 242. In this example, the user operates 
an adjusting bar 342 to thereby enable selection of ei- 
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ther color tone out of X-ray. high contrast, leave without 
change, sepia or monochrome. 

[0097] When the reproducing speed button 243 is op- 
erated, a window 351 as shown in FIG. 16 is displayed 
under the reproducing speed button 243. The user op- 
erates an adjusting bar 352 to thereby enable adjust- 
ment such that the reproducing speed of an image is 
quickened or made slow. 

[0098] An effect display button 244 is displayed under 
the reproducing speed button 243. The user gets drag 
and drop a selection button icon 364 displayed in FIG. 
17 described later or a selection button icon 364 dis- 
played in FIG. 1 7 described later a selection button icon 
362 displayed in FIG. 1 8 to the effect display button 244 
to thereby enable designation ofthe effect to a material 
displayed on a reproducing image plane 221. 
[0099] On the right side of the volume button 241 to 
the effect display button 244 is displayed a special effect 
tray 261 . Tags 271 -1 to 271 -4 are displayed on the spe- 
cial effect tray 261. 

[0100] When the tag 271 -2 is displayed, a text window 
is displayed as shown in FIG, 17. An image 361 as an 
editing object is displayed on the window. A font button 
362 is operated when a font of a text for imparting an 
effect is selected: A text input when a user operates the 
keyboard 4 is displayed on a text input window 363. A 
selection button icon 364 is operated when an effect 
added to a text (a row of letters or characters) is select- 
ed. A scroll bar 365^ is^ope rated when"the selection but- 
ton icon 364 is scrolled. 

[0101] A predetermined one out of the selection but- 
ton icons 364"is subjected to drag and drop on the effect 
display button 244 to thereby enable addition of a text 
input and displayed at that time, for example, a text an- 
imation to the text input window 363. When the repro- 
ducing button 231 is operated after the selection button 
icon 364 has been subjected to drag and drop on the 
effect display button 244, an image having the selected 
text effect added is displayed immediately on the repro- 
ducing image plane 221 . In this manner, the user is pos- 
sible to confirm the text effect at real time. 
[0102] In the FIG. 17 example, a text animation of "di- 
agonal coalescence" is displayed on the reproducing 
image plane 221 . 

[01 03] FIG. 1 8 represents a display example in a case 
where the tag 271 -3 is selected. When this tag 271 -3 is 
selected, an effect window is displayed as shown in the 
figure. On the window, an image 381 as an editing object 
is displayed, and a selection button iron 362 for selecting 
an animation effect is displayed thereunder. A scroll bar 
363 is operated when the selection button icon 362 is 
scrolled. 

[0104] Also in this case, a predetermined one out of 
the selection button icons 362 is subjected to drag and 
drop on the effect display button 244 to thereby enable 
selection of a predetermined animation effect. When the 
reproducing button 231 is operated after the selection 
has been made, an image having the animation effect 



added is displayed on the reproducing image plane 221 
at real time. In the FIG. 1 8 example, an animation effect 
of "palpitation" is displayed. 

[0105] FIG. 1 9 represents a display example in a case 
5 wherethetag271-4is selected. In this case, a transition 
window is displayed as shown in the figure. A selection 
button icon 391 is displayed on the window, and a user 
is able to select a predetermined one out of a plurality 
of selection button icons 391 . In a case where this se- 
10 lection is done, a schematic image corresponding to the 
selected transition is displayed on a display part 393. In 
a case where a scroll bar 392 is operated, the selection 
button icon 391 is scrolled. 

[0106] The user gets, after the predetermined selec- 
ts tion button icon 391 has been selected, drag and drop 
to a transition display part 301 B of an image truck 301 
shown in FIG. 20 to enable addition of transition to an 
image (material clip) displayed on an image display part 
301 A adjacent to the before and behind. 
20 [0107] For example, in a case where transition of the 
wipe is set, the transition is carried out while the image 
displayed on the left side in the figure is moving gradu- 
ally rightward so to gradually hide the image displayed 
on the right side as shown in FIG. 21 . 
25 [0108] When the tag 271-1 is selected, a shaker win- 
dow for automatic edition is displayed as shown in an 
enlarged scale in FIG. 22. Selection buttons 281-1 to 
281-5 are displayed on the shaker window. A predeter- 
- -mined scenario of a story-is corresponded in advance 
30 to the selection buttons 281 -1 to 281 -5. A preset prede- 
termined music is corresponded to each scenario, and 
the music corresponding to the selection button 281-1 
on the leftmost side in FIG. 22 is slowest in tempo, and 
the music corresponding to the selection button 281-5 
35 on the rightmost side is quickest and severe: The music 
corresponding to the selection buttons 281-2 to 281-4 
therebetween are respectively music of an intermediate 
tempo. 

[0109] Concretely, ambient music (environmental 
40 music), piano music, jazz music, hip-hop music, and 
techno-tone music are corresponded to the selection 
button 281-1 , the selection button 281-2, the selection 
button 281-3, the selection button 281-4 and the selec- 
tion button 281-5, respectively. 
45 [0110] Accordingly, the number of scenes constituting 
a scenario corresponding to the selection button 281 -1 
corresponding to these music is a relatively few (the 
change number of scenes is a few). On the other hand, 
scenario corresponding to the selection button 281-5 is 
so many in the scene number (the change times of scenes 
is many). The lengths of scenario corresponding to the 
selection buttons 281 -1 to 281 -5 are all the same, which 
is 30 seconds in this example. 

[0111] A loop button 282 is operated by a user, sup- 
55 posing that when a scenario of 30 seconds produced by 
automatic edition is respectively reproduced. A text 
shake button 283 is operated by a user when a text (let- 
ter) is shaken. When the text shake button 283 is oper- 



7 



13 



EP 1 168 838 A1 



14 



ated, a window 284 is displayed, and the user operates 
the keyboard 4 to enable input of a row of letters as an 
editing object into the window 284. In this example, three 
rows of letters, "Hold out !", "Junk-chan" and "Happy !!" 
are input and displayed. 

[01 12] A shake button 285 is operated by a user when 
the shake (automatic edition) is started. 
[01 1 3] When an output button 304 is operated, a win- 
dow 401 as shown in FIG. 23 is displayed. The user se- 
lects the desired item from the window 401 . Thereby, 
the form of storage of infonnation displayed on the out- 
put tray 291 (edited manually or automatically) can be 
selected. In a case, for example, "Store in simple form" 
is selected, a file including an image used and editing 
information of the image are stored. The editing infor- 
mation termed hereupon is, for example, information as 
shown in FIG. 24. In FIG. 24, the frame number on the 
leftmost side represents the timing at which each scene 
constituting its scenario begins. In Ihe FIG. 24 example, 
a scenario is constituted by 10 scenes, and the first 
scene begins from the 6 th frame. 

[0114] The next animation effect represents a proc- 
ess of animation effect corresponded to its scene. Since 
as the animation effect, 20 effects are prepared, values 
0 to 19 represent its effect, and the value 99 represents 
that the animation effect is not applied. Further, the val- 
ue - 1 represents that a predetermined one is selected 
from 20 animation effects at random. 
[0115] The next transition represents whicrr transition 
out of 8 transitions is. The value 99 represents that the 
transition is not applied. Further, the next transition rep- 
resents the timing of transition. 

[0116] The color tone effect represents which values 
of 0 to 23 are out of 24 kinds of color tones. The value 
-1 represents that a predetermined one is selected at 
random out of 24 kinds of color tones. The value 99 rep- 
resents that effect of color tone is not applied. 
[0117] The last value represents whether or not the 
black mat is used for the background. The value 1 rep- 
resents that the black mat is used as the background, 
and the value 0 represents not being used. 
[0118] On the other hand, in a case where "Store as 
a normal movie" shown in FIG. 23 is selected, editing 
infonnation as shown in FIG. 24 is actually applied to an 
image assigned to each scene to actually produce (ren- 
dering) image data with such an effect given. Accord- 
ingly, this process takes long time as compared with the 
case of "Store in simple form". In other words, "Store in 
simple form" is selected to thereby enable making the 
storage time short. 

[0119] Next, a shaker process (automatic editing 
process) will be described with reference to flowcharts 
of FIGS. 25A to 25C. The following process is basically 
executed by a shaker program 54D unless otherwise 
particularly not explained. First, in Step S1 , a read proc- 
ess is executed with a designated file as a material clip. 
That is, as mentioned above, a user starts a capture pro- 
gram 54E to designate a predetermined one out of a file 



of image data introduced from a CCD video camera 23 
and a file of voice data input from a microphone 24, and 
operates a read button 211 to designate the file as an 
object of an automatic editing process (material clip). 

5 When this designation process is carried out, the shaker 
program 54D stores the designated file as a material clip 
and processes an image of the first frame of the file to 
display it as a material clip 212 on a material tray 201 . 
In a case where designated information is voice infor- 

10 mation, an image representing that is voice infonnation 
prepared in advance is displayed. 
[0120] It is noted that the thus incorporated informa- 
tion include not only that is incorporated from a CCD 
video camera 23 and a microphone 24, that is incorpo- 

'5 rated through a modem 75 from an Internet 80, and 
those which are incorporated through an interface card 
112 from a magnetic disk 121 , an optical disk 122, an 
optical magnetic disk 123, and a semiconductor mem- 
ory 124. 

20 [0121] Next, the procedure proceeds to Step S2. The 
shaker program 54D executes, if a text is input as a 
shake object, a process for incorporating the input text. 
That is, the user operates, when carrying out the auto- 
matic editing process, the tag 271-1 to display a shaker 

25 window (see FIG. 22). In a case where the text shake 
takes place, the user further operates a text shake but- 
ton 283. Thereby, a window 284 is displayed as shown 
in FIG. 22. At that time, the user operates the key board 
4 to input a text to be shaken. The shaker program 54D 

30 incorporates this text to display it on the window 284. 
[0122] Further, the user designates one out of five 
shaker buttons 281-1 to 281-5. As mentioned above, re- 
spective predetermined scenarios are corresponded in 
advance to the shaker buttons 281-1 to 281-5, and the 

35 shaker button 281 is selected to thereby select its sce- 
nario. So, the shaker program 54D executes, when a 
predetermined one is designated out of the shaker but- 
tons 281 -1 to 281 -5, process for storing it. 
[0123] For example, a scenario as shown in FIG. 26A 

40 is corresponded to the selection button 281 -1 . This sce- 
nario is constituted by four scenes, scenes 1 to 4. The 
scenes 1 to 4 have lengths of the times T1 to T4. In a 
case of this example, an animation effect is added to the 
scene 1 , and monochromic color tone adjusting process 

« is carried out for the scene 2. Transition is added be- 
tween the scenes 1 and 2. Further, music M1 is corre- 
sponded to the scenario. 

[0124] As will be described in detail later, the shaker 
program 54D selects a predetermined one out of image 

so information of a material clip displayed on the material 
tray 201 at random to execute processes assigned to 
the scenes 1 to 4. As a result, the editing process along 
the scenario prepared in advance is automatically car- 
ried out by the shaker program 54D. 

55 [0125] FIG. 26B represents a scenario corresponded 
to the selection button 281-2. This scenario is constitut- 
ed by five scenes, scenes 1 to 5, lengths of which are 
T11 toT15, respectively. Sepia color, random effect, and 
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transition are added to the scene 2, the scene 3, and 
between the scene 4 and the scene 5, respectively. Mu- 
sic is M2. 

[0126] Though not shown, such a scenario is also cor- 
responded to the selection buttons 281-3 to 281-5, and 
prepared in advance. 

[01 27] In Step S4, the shaker program 54D executes 
process storing after a loop is designated. That is, the 
user operates, supposing that a scenario obtained by 
editing is reproduced continuously repetitively, a loop 
button 282. When this operation is carried out, the shak- 
er program 54D stores it in Step S4. 
[0128] For example, the scenario corresponding to 
the selection button 281-1 is basically constituted as 
shown in FIG. 26A, but the scene in a case where the 
loop button 22 is not operated is constituted, for exam- 
ple, as shown in FIG. 27A, more accurately. At this time, 
it is supposed that the scene is not reproduced contin- 
uously repetitively. That is, a fade-in portion SC1' is 
formed at the beginning of a scene 1 (SC1 ), and a fade- 
out portion SC4' is formed at the last scene 4 (SC4). 
Further, music M1 is also formed with a non-sound por- 
tion M1 ' at the last. 

[0129] Accordingly, when information edited on the 
basis of the scenario constituted as shown in FIG. 27A 
dares to reproduce continuously repetitively, there be- 
comes as shown in FIG. 27B. That is, reproducing is 
started by the fade-in portion SC 1', and a scene 1 , a 
scene 2] a scene 3, and a scene T4 are rejTrociucea, after 
which the first reproducing is ended by the fade-out por- 
tion SC4'. Continuously, reproducing of an image of the 
fade-in scene SC1' is again started to reproduce a 
scene 1 , a scene 2, a scene 3, and a scene 4, and the 
fade-out portion SC4' is again displayed. Also with re- 
spect to music, in a boundary portion A between thefirst 
reproducing and the second reproducing, the non- 
sound portion M1' is reproduced. Accordingly, a viewer 
is able to recognize easily that reproducing is once end- 
ed, in the boundary portion A. 

[0130] On the other hand, after the selection button 
281-1 is selected, and in a case where the loop button 
282 is also operated, a scenario as shown in FIG. 27C 
is selected. 

[0131] This scenario is constituted by four scenes, a 
scene 1 to a scene 4, but the top of the scene 1 and the 
last of the scene 4 are constituted such that even if the 
scene 1 should be reproduced following the scene 4, for 
example, the scene changes similar to the timing of 
switching between the scene 1 and the scene 2, or the 
tinning of switching between the scene 2 and the scene 
3, or the timing of switching between the scene 3 and 
the scene 4, and recognition that one scenario is ended 
is not made. That is, it is constituted such that recogni- 
tion may be made that an image plane is merely 
switched. 

[0132] Likewise, it is constituted such that even if the 
music M1 should be again reproduced continuously fol- 
lowing reproducing from the top to the end of the music 



M1 , recognition that the scene is ended at that portion 
is not made. 

[0133] As a result, as shown in FIG. 27D, even if the 
scenes 1 to 4 should be again reproduced continuously 
5 following the scenes 1 to 4, there is less possibility that 
a viewer recognizes intuitively that the first reproducing 
is ended and the second reproducing is started in the 
boundary portion A. 

[0134] As described above, the shaker program 54D 
10 has two scenarios, a scenario supposing of not being 
reproduced continuously repetitively, and a scenario 
supposing of being reproduced continuously repetitive- 
ly, corresponding to the selection buttons 281-1 to 
281 -5. In a case where the loop button 282 is not oper- 
as ated, the former is selected, and in a case where the 
loop button 282 is operated, the latter is selected. 
[0135] Next, in Step S5, the shaker program 54D 
judges whether or not the shaker button 285 is operated; 
in a case of not being operation, the step returns to Step 
20 S1 , where the thereafter processes are executed repet- 
itively. In a case where judgement is made that the 
shake button 285 is operated, the step proceeds to Step 
S6, where the shaker program 54D judges whether or 
not a loop is designated, that is, judges whether or not 
25 the loop button 282 is operated. In a case where judge- 
ment is made that the loop is designated, the step pro- 
ceeds to Step S7, where the shaker program 54D se- 
lects a scenario for a loop corresponding to that operat- 
ed out of the selection buttons 281=1 to 281^5: On the 
30 other hand, in Step S6, in a case where judgement is 
made that the loop is not designated, the shaker pro- 
gram 54D selects, in Step S8, a scenario for a non-loop 
corresponding to that operated out of the selection but- 
tons 281-1 to 281 -5. 
35 [0136] After the process of Step S7 or Step S8, the 
step proceeds to Step S9, where the shaker program 
54D assigns ID (Identification Number) to respective 
material clips 212 displayed on the material tray 201 . In 
Step S10, the shaker program 54D selects one of the 
40 material clips at the random number. In other words, one 
ID is selected at random out of IDs assigned in the proc- 
ess in Step S9 whereby one material clip is selected. 
[0137] In Step S11 , the shaker program 54D causes 
the material clip selected in the process in Step S10to 
45 correspond to one scene (in this case, the first scene) 
out of the scenario selected in the process in Step S7 
or Step SB. 

[01 38] In Step S1 2, judgement is made whether or not 
corresponding process of the material clips with respect 

50 to all the scenes are ended; in a case of not yet being 
ended, the step returns to Step S10, where thereafter 
processes are executed repetitively. In this manner, for 
example, the respective predetermined material clips 
are corresponded to the scene 1 , the scene 2, the scene 

55 3, and the scene 4 shown in FIG. 26A. 

[0139] In Step S12, in a case where judgement is 
made that the corresponding process with respect to all 
the scenes is ended, the step proceeds to Step S 13, 
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where the shaker program 54D selects one scene. For 
example, hereupon, the head scene is selected. In Step 
S 1 4, the shaker program 54D judges whether or not the 
length of the scene selected in Step S13 is shorter than 
that of the material clip corresponded to that scene, in 
a case where the length of the selected scene is shorter 
than that of the material clip corresponded, the step pro- 
ceeds to Step S15, where the shaker program 54D de- 
cides a portion corresponded to a scene in the material 
clips at random number. For example, in a case where 
the length of the material clip is 5 seconds, and the 
length of the corresponding scene is 1 second, whether 
an image for which 1 second out of 5 seconds is corre- 
sponded to the scene is decided by generating numer- 
als 1 to 5 at random number. 

[0140] On the other hand, in a case where in Step 
S14, judgement is made that the length of a scene se- 
lected is not shorter than that of the material clip corre- 
sponded, the step proceeds to Step S16, where the 
shaker program 54D executes process for extending the 
length of the material clip so as to adjust to the length 
of the scene. For example, in a case where the length 
of the material clip is 1 second, and the length of the 
scene is 5 seconds, the length of the material clip is ex- 
tended by five times (reproducing at the speed of 1/5 
time), that is, slow motion reproducing is done whereby 
the length of the material clip is corresponded to the 
length of the scene. 

[0141] After the process of Step" S1 5 or Step S16, the 
step proceeds to Step S17, where the shaker program 
54D judges whether or not effect is designated to the 
scene in that scenario. For example, in a case where 
now, a scene as a process object is a scene 1 in FIG. 
28A, animation effect is designated to the scene 1. In 
such a case, the step proceeds to Step S1 8, where the 
shaker program 54D judges whether or not the effect is 
decided. That is, designation of effect includes a case 
where effect is already decided such that effect is ani- 
mation effect as in a case of the scene 1 of FIG. 26A, 
and a case where effect is designated as random effect 
as in a case of the scene 3 of FIG. 26B, for example. In 
a case of the random effect, addition of effect is deter- 
mined, but what effect is applied is not yet decided. Ac- 
cordingly, in such a case, the step proceeds to Step S19, 
where the shaker program 54D is prepared in advance. 
For example, the random number is generated out of 24 
effects to decide one effect. 

[0142] In a case where in Step S18, judgement is 
made that effect is already decided, or in a case where 
in Step S19, effect is decided, the step proceeds to Step 
S20, where the shaker program 54D causes the decided 
effect to correspond to the material clip corresponded 
to the scene. 

[0143] In a case where in Step S17, judgement is 
made that effect is not designated to a scene, the proc- 
esses of Step S18 to Step S20 are unnecessary, which 
steps are therefore omitted. 

[0144] Next, in Step S21, the shaker program 54D 



judges whether or not transition is designated. In a case 
where transition is designated, the step proceeds to 
Step S22, where the shaker program 54Dsets transition 
between the next material clips. Thereby, for example, 

s when an image plane of a scene as a process object at 
present is switched to that of a scene to be a process 
object next, wipe effect as shown, for example, in FIG. 
21 is given to switch an image plane. 
[0145] In a case where in Step S21, judgement is 

10 made that no designation of transition is present, the 
process of Step S22 is unnecessary, which is therefore 
skipped. 

[0146] In Step S23, the shaker program 54D judges 
whether or not text is incorporated. That is, as described 
15 above, in a case where text shake is carried out, a text 
as an object thereof is incorporated in Step S2. In this 
case, the step proceeds to Step S24, where the shaker 
program 54D decides whether or not text is shaken in a 
scene as a process object now is decided at random. In 
Step S25, the shaker program 54D judges whether or 
not the text shake is done; in a case where judgement 
is made that the text shake is done, the step proceeds 
to Step S26, where one text is selected at random out 
of texts incorporated. For example, in a case where 
three texts are incorporated as shown in FIG. 22, one 
text out of them is selected to be corresponded to the 
scene to be a process object now. 
[0147] Next, in Step S27, the shakerprogram 54D de- 
cides insert positions of a text at random. In a case of 
this example, the insert positions of a text are five posi- 
tions, centre, right above, left above, left below, and right 
below, and one position is decided at random out of 
these five positions. 

[0148] In a case where in Step S25, judgement is 
made that no text shake is done, processes of Step S26 
and Step S27 are skipped. Further, in a case where in 
Step S23, judgement is made that no text is incorporat- 
ed, processes of Step S24 to Step S27 are skipped. 
[0149] Next, in Step S28, judgement is made whether 
or not the process with respect to all the scenes is end- 
ed; and in a case where the process with respect to all 
the scenes is not ended, the step returns to Step S13, 
where the process similar to the aforementioned case 
is executed with respect to next scene. 
[0150] In a case where in Step S28, judgement is 
made that the process with respect to all the scenes is 
ended, the step proceeds to Step S29, where the shaker 
program 54D causes an image corresponding to the ed- 
ited scenario to be displayed on an image truck 301 of 
an output tray 291 . At this tune, an image of a frame at 
the head of each scene is displayed on an image display 
part 301 A of the image truck 301 , and in a case where 
transition is present, an image corresponding to the 
transition (see FIG. 19) is displayed on a transition dis- 
play part 301 B. 

[0151] The above-described processes will be sche- 
matically explained with reference to FIG. 28. 
[0152] That is, in a case of this example, as material 
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clips, material clips CL1 to CL5 are designated. One 
scenario is decided by operation of a selection burton 
281 designated by a user. In a case of this example, this 
scenario is constituted by n numbers of scenes, scenes 
SC1 to SCn. Out of them, the scene SC3 is subjected 
to color tone adjustment of sepia color, the random ef- 
fect is given to the scene SC<SUB>n-1 </SUB>, and the 
scene SC<SUB>n</SUB> is subjected to color adjust- 
ment of sepia color. Transitions are respectively formed 
between the scenes SC2 and SC3, between the scenes 
SC3 and SC4, and between the scene SC<SUB>n-1 <J 
SUB> and the scene SC<SUB>n</SUB>. The length of 
the scene. SC1 is 2 seconds, the length of the scene 
SC2 is 2.2 seconds, the length of the scene SC3 is 4.0 
seconds, the length of the scene SC<SUB>n-3</SUB> 
is 1 second, the length of the scene SC<SUB>n-1</ 
SUB> is 5 seconds, and the length of the scene 
SC<SUB>n</SUB> is 3 seconds. Further, music corre- 
sponding to the scene is decided in advance. These are 
already prepared in advance by the shaker program 
54D. 

[0153] On the other hand, the shaker program 54D 
selects a predetermined one out of five material clips 
CL1 to CL5 at random to assign it to each scene SC1 
to SC<SUB>n</SUB>. And, for example, in a case 
where the material clip CL5 is assigned to the scene 
SC<SUB>n-3</SUB>, the length of the scene 
SC<SUB>n-3</SUB> is 1 second while the length of the 
material clip CL5 is not less than 1 second." So, irf this 
case, out of the reproducing time of the material clip 
CL5, t1 to t4, a portion of the length of 1 second from 
the time t2 to t3 selected at random is assigned to the 
scene SC<SUB>n-3</SUB>. 

[0154] In such a manner as described above, the user 
merely designates a material clip to thereby enable ob- 
taining image information subjected to predetermined 
editing process automatically. Since the designation of 
element clips is decided at random, even if one and the 
same material clip is selected, a different editing result 
is basically to be obtained. 

[01 55] When in the state that the editing result is dis- 
played on the output tray 291 , the reproducing button 
231 is operated, the shaker program 54D causes the 
image corresponding to the edited scenario (which is 
obtained by modifying a scenario prepared in advance) 
to be- displayed on the reproducing image plane 221. 
The user is able to confirm the editing result thereby. 
[01 56] When the user operates the output button 304 
after confirmation in the reproducing image plane, the 
window 401 as shown in FIG. 23 is displayed. The user 
selects a predetermined item out of items displayed on 
the window 401 to thereby enable storing information 
obtained as a result of edition in a predetermined form. 
[0157] In a case where "Store as a normal movie" is 
selected, the shaker program 54D actually applies ed- 
iting information to the selected material clip to execute 
the rendering process. As a result, for example, an im- 
age with a predetermined result is formed, and the im- 



20 

age is stored in a designated storage medium, for ex- 
ample, the hard disk 67. 

[0158] However, it takes relatively long time to exe- 
cute the rendering process. On the other hand, in a case 

5 where "Store in simple form" is selected, the actual ren- 
dering process is not executed, but a file of the material 
clip selected as an editing object and editing formation, 
for example, information as show n in FIG. 24, is stored. 
Accordingly, the storing process can be completed in a 

10 short period of time as compared with the case where 
the rendering process takes place. 
[0159] It is noted that even the processes shown in 
the flowcharts of FIGS. 25A to 25C, the rendering proc- 
ess is not actually carried out, but this is a process that 

15 editing information as shown in FIG. 24 is merely pre- 
pared. As a consequence, for example, it is possible to 
edit, scenario whose length is 30 seconds in a short pe- 
riod of time of ten seconds at the most. 
[0160] The program which executes the above-de- 

20 scribed process can be provided for a user in a state 
that is installed in advance in the hard disk 67 as a stor- 
age medium housed in the personal computer 1 or in 
ROM 70 as a semiconductor memory. 
[0161] Alternatively, the program can be provided as 

25 a package software in which it is temporarily or perma- 
nently stored in the magnetic disk 121 such as a floppy 
disk : the optical disk 122 such as CD-ROM (Compact 
Disk-Read Only Memory), the optical magnetic disk 
1 23 7 orthe semiconductor memory 1 24. 

30 [01 62] Further, it is possible that the program is trans- 
ferred by radio transmission from the down-load site to 
the personal computer 1 through an artificial satellite for 
digital satellite broadcasting, or transferred by wire to 
the personal computer 1 through a local area network 

35 or Internet, and in the personal computer, the program 
can be stored in the hard disk 67 housed therein or the 
like. 

[0163] In the present invention, the medium termed 
hereupon means a conception in a broad sense includ- 

40 ing all the media described above. 

[0164] Further, in the present invention, the step for 
describing the program provided by the medium in- 
cludes, of course, a process carried out in a time se- 
quence along order described, and also a process exe- 

45 cuted in parallel or individually, even not always proc- 
essed in a time sequence. 

[0165] It is noted that in the above-described expla- 
nation, the system termed herein represents the whole 
apparatus constituted by a plurality of devices. 

so 

Industrial Applicability 

[01 66] According to the present invention, since a pre- 
determined one is selected out of image information so 
55 as to correspond it to a scene, it is possible to carry out 
the editing process quickly and simply. 
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Claims 

1. An information processing apparatus comprising: 

memory means for storing scenario data con- 
stituted by a plurality of scenes; and 
corresponding means for suitably correspond- 
ing a plurality of images as an editing object to 
each of said plurality of scenes constituting said 
scenario data stored in said memory means. 

2. The information processing apparatus according to 
claim 1 , wherein said plurality of scenes are prede- 
termined lengths different from each other. 

3. The information processing apparatus according to 
claim 1 further comprising: 

modification means for modifying said image 
corresponded by said corresponding means adjust- 
ing to said length of a scene. 

4. The information processing apparatus according to 
claim 3 further comprising: 

reproducing means for continuously repro- 
ducing said plurality of images corresponded by 
said corresponding means on the basis of said sce- 
nario data. 

5. The information processing apparatus according to 
claim 4, wherein said reproducing means applies, 
on the basis of predetermined special effect infor- 
mation corresponded to said scene, said special ef- 
fect information to said plurality of images to repro- 
duce the latter. 

6. The information processing apparatus according to 
claim 4 further comprising: 

decision means for suitably deciding the spe- 
cial effect information corresponded from the 
plurality of special effect information to said 
scene; wherein 

said reproducing means applies said special ef- 
fect information to said plurality of images, on 
the basis of decision result of said decision 
means, to reproduce the latter. 

7. The information processing apparatus according to 
claim 1 , wherein said corresponding means for suit- 
ably corresponding said plurality of images as an 
editing object to said plurality of scenes of scenario 
data selected out of a plurality of scenario data. 

8. The information processing apparatus according to 
claim 1 further comprising: 

registration means for registering images to be 
an editing object; 



image information display means for displaying 
in list information relating to said plurality of im- 
ages as an editing object; and 
output information display means for arranging 
5 and displaying information relating to said plu- 

rality of images corresponded by said corre- 
sponding means in accordance with order of 
said plurality of scenes. 

10 9. The information processing apparatus according to 
claim 7, wherein said corresponding means uses a 
first scenario with repetitive continuous reproducing 
as a premise, and a second scenario with repetitive 
reproducing as a non-premise to carry out corre- 
sponding. 

10. An information processing method comprising the 
steps of: 

corresponding processing for suitably corre- 
sponding a plurality of images as an editing ob- 
ject to each of a plurality of scenes constituting 
scenario data; 

modification processing said images corre- 
sponded adjusting to a length of each of said 
scenes; and 

reproducing processing for continuously repro- 
ducing said plurality of images on the basis of 
said scenario data. 

11. The information processing method according to 
claim 10 further comprising: decision processing 
step of suitably deciding special effect information 
corresponded out of a plurality of special effect in- 
formation to said scene. 

12. The information processing method according to 
claim 1 0 further comprising: 

image information display processing step of 
displaying in list information relating to said plu- 
rality of images as an editing object; and 
output information display processing step of 
arranging and displaying information relating to 
said plurality of images corresponded by said 
corresponding means In accordance with order 
of said plurality of scenes. 

13. A program storage medium in which a program ca- 
pable of being read by a computer is stored, said 
program comprising: 

corresponding processing step of suitably cor- 
responding a plurality of images as an editing 
object to each of a plurality of scenes constitut- 
ing scenario data; 

modification processing step of modifying each 
of said images corresponded adjusting to a 
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length of each of said scenes; and 
reproducing processing step of continuously 
reproducing said plurality of images on the ba- 
sis of said scenario data. 

5 

14. The program storage medium in which a program 
capable of being read by a computer is stored ac- 
cording to claim 10, said program further compris- 
ing: 

decision processing step of suitably deciding to 
special effect information corresponded out of a plu- 
rality of special effect information to said scene. 

15. The program storage medium in which a program 
capable of being read by a computer is stored ac- ts 
cording to claim 13, said program further compris- 
ing: 

image information display processing step of 
displaying in list information relating to said plu- 20 
rality of images as an editing object; and 
output information display processing step of 
arranging and displaying information relating to 
said plurality of images corresponded by said 
corresponding processing step in accordance 25 
with order of said plurality of scenes. 
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